This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 

• BLANK PAGES 

IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



It******* 0 * 




„ 2 ,UK Patent Application „ 9 ,GB „„2 344917 ,»A 



(43) Date of A Publication 21.06.2000 



l'>^\ 
{■ill 


Application No 9929392.0 


(51) 


INT CL 7 










G10L 15/22 G06F 3/16 G10L 15/06 15/96 


ion 
Kill 


Date of Filing 14.12.1999 














UK CL (Edition R \ 


(30) 


Priority Data 






o4H HMA nnL Kir 




(31) 09213858 


(32) 16.12.1998 (33) US 




G4A AKS 




(31) 09213856 


(32) 17.12.1998 




U1S S2124 S2126 




(3D 09213846 


(32) 17.12.1998 








(3D 09213845 


(32) 17.12.1998 


(56) 


Documents Cited 










EP 0841655 A2 

Field of Search 


(71) 


Appltcant(s) 




(58) 




International Business Machines Corporation 




UK CL (Edition R ) G4P. REX RHA RRL RRM 




(Incorporated in USA - New York) 




INT CL 7 G06F 3/00 3/16 , G10L 15/00 15/08 15/22 




Armonk, New York 10504, United States of America 




15/26 










Online WPI, EPODOC, JAPIO 


(72) 


Inventor(s) 









Scott A Morgan 

David J Roberts (74) Agent and/or Address for Service 

Craig A Swearingen M J Jennings 

Alan R Tannenbaum IBM United Kingdom Limited, Intellectual Property 

Anthony C Temple Department, Hursley Park, WINCHESTER, Hampshire, 

SQ21 2JN, United Kingdom 



(54) Abstract Title 

Speech command input recognition system 



(57) An interactive computer controlled display system with speech command input recognition and visual 
feedback includes means for predetermining a plurality of speech commands for respectively initiating 
corresponding system actions and means for providing for each command an associated set of speech terms, 
each term having relevance to its associated command. The system provides means responsive to a detected 
speech command for displaying the command, and means responsive to a detected speech term having 
relevance to one of the commands for displaying the relevant command. The system preferably displays the 
basic speech commands simultaneously along with the relevant commands. 

The means for providing the associated set of speech terms comprise a stored relevance table of 
universal speech input commands and universal computer operation terms conventionally associated with 
actions initiated by the input commands. 
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SPEECH COMMAND INPUT RECOGNITION SYSTEM 



Technical Field 

The present invention relates to interactive computer controlled 
display systems with speech command input and more particularly to such 
systems which present display feedback to the interactive users. 

Background of Related Art 

The lS90's decade has been marked by a technological revolution 
driven by the convergence of the data processing industry with the 
consumer electronics industry. This advance has been even further 
accelerated by the extensive consumer and business involvement in the 
Internet over the past few years. As a result of these changes it seems 
as if virtually all aspects of human endeavor in the industrialized world 
require human/computer interfaces. There is a need to make computer 
directed activities accessible to people who up to a few years ago were 
computer illiterate or, at best/ computer indifferent. 

Thus, there is continuing demand for interfaces to computers and 
networks which improve the ease of use for the interactive user to access 
functions and data from the computer. with desktop- like interfaces 
including windows and icons, as well as three-dimensional virtual reality 
simulating interfaces, the computer industry has been working hard to 
fulfil such user interaction by making interfaces more user friendly by 
making the human/computer interfaces closer and closer to real world 
interfaces, e.g. human/human interfaces. In such an environment, it 
would be expected that speaking to the computer in natural language would 
be a very natural way of interfacing with the computer for even novice 
users. Despite these potential advantages of speech recognition 
computer interfaces, this technology has been relatively slow in gaining 
extensive user acceptance. 



years, but it has only recently begun to find commercial acceptance, 
particularly with speech dictation or "speech to text" systems, such as 
those marketed by international Business Machines Corporation ( IBM J and 
Dragon Systems. That aspect of the technology is now expected to have 
accelerated development until it will have a substantial niche in the 
word processing market. On the other hand, a more universal application 
o£ speech recognition input to computers, which is still behind 
expectations in user acceptance, is in. command and control technology, 
wherein, for example, a user may navigate through a computer system's 
graphical user interface (GUI) by the user speaking the commands which 



Speech recognition technology has been available for over twenty 



are customarily found in the systems' menu text, icons, labels, buttons, 
etc . 



Many of the deficiencies in speech recognition both in word 
5 processing and in command technologies are due to inherent voice 

recognition errors due in part to the status of the technology and in 
part to the variability of user speech patterns and the user's ability to 
remember the specific commands necessary to initiate actions. As a 
result, most current voice recognition systems provide some form of 

10 visual feedback which permits the user to confirm that the computer 

understands his speech utterances. In word processing, such visual 
feedback is inherent in this process, since the purpose of the process is 
to translate from the spoken to the visual. That may be one of the 
reasons that the word processing applications of speech recognition has 

15 progressed at a faster pace. 

However, in speech recognition driven command and control systems, 
the constant need for switching back and forth from a natural speech 
input mode of operation, when the user is requesting help or making other 
20 queries, to the command mode of operation, when the user is issuing 

actual commands, tends to be very tiresome and impacts user productivity, 
particularly when there is an intermediate display feedback. 
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Summary of the Present Invention 



The present invention is directed to providing solutions to one or 
more of the above- listed needs of speech recognition systems. Preferred 
embodiments of the invention provide command and control systems which 
are heuristic both on the part of the computer in that it learns and 
30 narrows from the natural speech to command user feedback cycles and on 

the part of the user, in that he tends to learn and narrow down to the 
computer system specific commands as a result of the feedback cycles. 

The present invention is directed to an interactive computer 
35 controlled display system with speech command input recognition which 

includes means for predetermining a plurality of speech commands for 
respectively initiating each of a corresponding plurality of system 
actions in combination with means for providing, for each of said 
plurality of commands, an associated set of speech terms, each term 
4 3 having relevance to its associated command. Also included are means for 

detecting speech command and speech terns. Responsive to such detecting 
means, the system provides means responsive to a detected speech command 
for displaying said command, and cear.s responsive to a detected speech 
term having relevance to one of said commands for displaying the relevant 
4 5 command . 



A system implementing the invention preferably provides interactive 
means for selecting a displayed command to thereby initiate a system 
action. These selecting means are preferably speech command input means. 
The system can display the actual speech commands, i.e., commands 
actually spoken by the user simultaneously with the relevant commands 
i.e., commands not actually spoken but found in response to spoken terms 
having relevance to the commands. 

The system of the present invention is particularly effective when 
used in the implementation of distinguishing actual spoken commands from 
spoken queries for help and other purposes. 

in accordance with an aspect of the invention, the means for 
providing said associated set of speech terms comprise a stored relevance 
table of universal speech input commands and universal computer operation 
terms conventionally associated with actions initiated by said input 
commands, ajid means for relating the particular interactive interface 
commands of said system with terms in said relevance table. 

in another aspect, the present invention provides a system for 
confirming the recognition of a command by first predetermining a 
plurality of speech commands for respectively designating each of a 
corresponding plurality of system actions and providing means for 
detecting such speech commands. There also are means responsive to a 
detected speech command for displaying said command for a predetermined 
time period, during which time the user may give a spoken command to stop 
the system action designated by said displayed command. In the event that 
said system action is not stopped during said predetermined time period, 
the system action designated by said displayed command will be executed. 
The user need not wait for the expiration of the time period if he notes 
that the displayed command is the right one; he has speech command means 
for executing the system action designated by said displayed command 
prior to the expiration of said time period. This may be as simple as 
just repeating the displayed command. 

in a further aspect, the invention provides a speech recognition 
system which interprets speech queries such as help queries and presents 
a list of relevant proposed commands sorted in order based upon relevance 
of the commands. The system organizes the displayed commands being 
prompted to the user through probability determining means which for each 
of a predetermined plurality of speech commands store an associated set 
of speech terms, each term having relevance to its associated command 
combined with means responsive to a speech query for determining the 
probability of speech terms from said set in said query, and means 
responsive to said probability determining means for prompting the user 
with a displayed sequence of commands sorted based jpon said probability 



of speech terms associated with said commands. when such a sorted 
command is selected, the system has means responsive to a speech command 
for carrying out the system action corresponding to the command. 
Preferably, means for determining probability of speech terms weight said 
5 probability upon the firmness of recognition of the speech terms. 

Excellent results are achieved when in determining said probability, a 
firm recognition of a speech term is accorded twice the weight of an 
infirm recognition of the term. Also, if the speech query has a term 
which is an exact match with any command, then in the sorting of 

10 displayed commands, any exact match of a speech term with any command 

doubles the weight accorded to that command in the sorting. The system 
also provides means for adding terms to previous speech terms wherein the 
probability determining means will redetermine probability to include 
such added terms. In such a situation, the probability determining means 

15 will redetermine the weights to include the additional weights of such 

added terms . 

In a further aspect, the invention provides a speech recognition 
system which does not switch modes of operation when interpreting speech 

20 queries, such as help queries, or receiving actual spoken commands. The 

system handles both concurrently and seamlessly in the same operation 
mode. The present invention is directed to an interactive computer 
controlled display system with speech recognition comprising means for 
predetermining a plurality of speech commands each associated with a 

25 corresponding plurality of system actions in combination with means for 

concurrently detecting speech commands and speech queries for locating 
commands. There is also provided means responsive to a detected speech 
command for carrying out the system action corresponding to the command, 
and means responsive to a detected speech query for attempting to locate 

30 commands applicable to said query. The system also included means for 

displaying the detected speech query together with means for displaying 
located commands applicable to said query. The system may further 
include means responsive to a detected speech query for modifying a 
displayed prior speech query whereby a user may speak a displayed located 

35 command to activate said means for carrying out a system action or speak 

a query to modify said prior query to locate commands other than said 
displayed commands without switching between command and query modes of 
speech detection. 

4 C Brief Description of the Drawings 

The present invention will be better understood and its numerous 
advantages will become more apparent to those skilled i n the art by 
reference to the following drawings, in conjunct ion with the accompanying 
4 5 descrip: ;on of exarr.pie embed imen t s , in which: 



Fig. 1 is a block diagram of a generalized data processing system 
including a central processing unit which provides the computer 
controlled interactive display system with voice input used in practicing 
the present invention; 

Fig. 2 is a block diagram of a portion of the system of Fig. i 
showing a generalized expanded view of the system components involved in 
the implementation; 

Fig. 3 is a diagrammatic view of a display screen on which an 
interactive dialog panel interface used for visual feedback when a speech 
command and/or speech term input has been made; 

Fig. 4 is the display screen view of Fig. 3 after a speech term 
input has been made; 

Fig. 5 is the display screen view of Fig. 4 after the user has 
finished inputting the speech term in Fig. 4. (The user may then say one 
of the listed commands.),- 

Fig. 6 is a flowchart of the basic elements of the system and 
program in a computer controlled display system for creating and using 
the speech command recognition with visual feedback system of the present 
invention; and 

Fig. 7 is a flowchart of the steps involved in running the program 
set up in Fig. 6. 

Detailed Descrip tion of the Preferred Embodiment 

Referring to Fig. 1, a typical data processing system is shown 
which may function as the computer controlled display terminal used in 
implementing the system of the present invention by receiving and 
interpreting speech input and providing a displayed feedback, including 
some recognized actual commands, as well as a set of proposed relevant 
commands derived by comparing speech terms (other than commands) to a 
relevance table. A central processing unit (CPU) 10, such as any PC 
microprocessor in a PC available from IBM or Dell Corp. is provided and 
interconnected to various other components by system bus 12. An 
operating system 4 1 runs on CPU 10. provides control and is used to 
coordinate the function of the various components of Fig. i. Operating 
system 4 1 .ay be one of the commercially available operating systems such 
as the OS/2(TM) operating system available from IBM (OS/2 is a trademark 
of IBM); Microsoft's windows 95(TM) or windows NT(TK), as well as the 
UNIX or a:x operating systems. a speech recognition program with visual 
feedback of proposed relevant commands, application 40, to be 




6 

subsequently described in detail, runs in conjunction with operating 
system 4 1 and provides output calls to the operating system .4 1, which 
implements the various functions to be performed by the application 40. 

5 A read only memory (ROM) 16 is connected to CPU 10 via bus 12 and 

includes the basic input/output system (BIOS) that controls the basic 
computer functions. Random access memory (RAM) 14, I/O adapter 18 and 
communications adapter 34 are also interconnected to system bus 12. it 
should be noted that software components, including operating system 41 

10 and application 40, are loaded into RAM 14, which is the computer 

system's main memory. I/O adapter 18 may be a small computer system 
interface (SCSI) adapter that communicates with the disk storage device 
20, i.e. a hard drive. Communications adapter 34 interconnects bus 12 
with an outside network enabling the data processing system to 

15 communicate with other such systems over a local area network (LAN) or 

wide area network (WAN) , which includes, of course, the Internet. I/O 
devices are also connected to system bus 12 via user interface adapter 22 
and display adapter 36. Keyboard 24 and mouse 26 are all interconnected 
to bus 12 through user interface adapter 22. Audio output is provided by 

20 speaker 28 and the speech input which is made through input device 27, 

which is diagrammat ical ly depicted as a microphone which accesses the 
system through an appropriate interface adapter 22. The speech input and 
recognition will be subsequently described in greater detail, 
particularly with respect to Fig. 2. Display adapter 36 includes a frame 

25 buffer 39, which is a storage device that holds a representation of each 

pixel on the display screen 38. Images, such as speech input commands, 
relevant proposed commands, as well as speech input display feedback 
panels, may be stored in frame buffer 39 for display on monitor 38 
through various compcnen;s such as a digital to analog converter (not 

30 shown) and the like. By using the aforementioned I/O devices, a user is 

capable of inputting visual information to the system through the 
keyboard 24 or mouse 2 6 in addition to speech input through microphone 27 
and receiving output information from the system via display 38 or 
speaker 28 . 

35 

Now with respect to Fig. 2, we will describe the general system 
components involved in implementing the invention. voice or speech input 
5 0 is applied through microphone 51 which represents a speech input 
device. since the art of speech terminology and speech command 

4C recognition is an old and well developed one, we will net go into the 

hardware and system details of a typical system which may be used to 
implement the present invention. It should be clear to those skilled in 
the art that the sysner.s and hardware in any of the following patents may 
be used: US5.671.3 23 ; 'JS5 , 1 3 3 , 1 1 1 ; U35 , 222 , 14 6 ; US5, 664,0 61; 

45 US 5 , 5 5 3, 12 1; and US 5 , 1 5 7 , 3 = 4 . The speech input to the system could be 

actual spoken coxites , which the system will recognize, and /or speech 



terminology, which the user addresses to the computer so that the 
computer may propose appropriate relevant commands through feedback. The 
input speech goes through a recognition process which seeks a comparison 
to a stored set of commands 52. if an actual spoken command is clearly 
identified, spoken command 55, that command may be carried out and then 
displayed via display adapter 36 to display 38, or the spoken command may 
be displayed first and subsequently carried out. In this regard, the 
system is capable of several options, as will be subsequently described 
in greater detail. Suffice it to state that the present invention 
provides the capability of thus displaying actual commands. 

where the speech input contains terminology other than actual 
commands, the system provides for a relevance table 53, which is usually 
a comprehensive set of terms which may be used in any connection to each 
of the actual stored commands 52. If any of the input speech terms 
compare 54 with one of the actual commands, that actual command is 
characterized as a relevant command 56 which is then also presented to 
the user on display 38 via display adapter 36. Although the relevance 
will be subsequently described in detail, it would be appropriate to 
indicate here how such a table is created. Initially, an active 
vocabulary is determined. This includes collecting from a computer 
operation, including the operating system and all significant application 
programs, all words and terms from menus, buttons and other user 
interface controls including the invisible but active words from 
currently active application windows, all names of macros supplied by the 
speech system, the application and the user, names of other applications 
that the user may switch to, generic commands that are generic to any 
application and any other words and terms which may be currently active. 
This basic active vocabulary is constructed into a relevance table 
wherein each word or term will be related to one or more of the actual 
commands and conversely, each of the actual commands will have associated 
with it a set of words and terms which are relevant to the command. rt 
should be noted that this relevance table is dynamic in that it may be 
added to as appropriate to each particular computer operation. Let us 
assume that for a particular computer system there is a basic or generic 
relevance table of generic terminology, the active vocabulary for the 
particular system set is added to the basic relevance table and an 
expanded relevant vocabulary is dynamically created using at least some 
of the following expedients: 

each word or phrase in the active vocabulary is added to the 
expanded vocabulary with an indication that it is an original active 
vocabulary word or phrase; 

each word or phrase in the active vocabulary is looked up as 
an index into the relevance table. If found, the corresponding contents 
of zhe ceil in the table are used to further expand the vocabulary with 
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any additional words or phrases that the cell may contain. .These 
additional terms would have an" associated reference to the active entry 
which caused its inclusion; 

each phrase is then broken into its constituent words, word 
pairs and n-word subphrases where applicable and the above process 
repeated ; 

users may be encouraged to come up with there own lists of 
words and phrases which may be indexed with respect to the relevance 
table; and 

a synonym dictionary may be an additional source for words 

and phrases . 



In the above description of display of commands both spoken and 
relevant with respect to Fig. 2, we did not go into the display of the 
spoken input which could include commands and speech terms which would be 
compared to the relevance table for relevant commands. It will be 
understood that the spoken input will also be displayed separately. This 
will be seen with respect to rigs. 3 through 5 which will provide an 
illustrative example of how the present invention may be used to give the 
visual feedback of displayed spoken commands, as well as relevant 
commands in accordance with the present invention. When the screen image 
panels are described, it will be understood that these may be rendered by 
storing image and text creation programs, such as those in any 
conventional window operating system in the RAM 14 of the system of Fig. 
25 1 - The display screens of Figs. 3 through 5 are presented to the viewer 

on display monitor 3 8 of Fig. 1. m accordance with conventional 
techniques, the user may control the screen interactively through a 
conventional I/O device such as mouse 26, F lg . i, and speech input is 
applied through microphone 27. These operate through user interface 22 
to call upon programs in ram 14 cooperating with the operating system 41 
to create the images in frame buffer 39 of display adapter 36 to control 
the display panels on monitor 38. The initial display screen of Fig. 3 
shows a display screen with visual feedback display panel 70. in the 
panel, window 71 will show the words that the user speaks while window 72 
will display all of the relevant commands, i.e. commands which were not 
actually spoken but some the spoker. words or phrases in the window 71 
were associated with the relevant ccnvr.ar.ss through the relevance table, 
as shown in Fig. 2. Also, any spoker. commands which were part of the 
spoken input in window 71 win also be listed along with the relevant 
40 commands ir. window 72. The par.el also has command buttons: by pressing 

button 73 or saying the command. "Clear List", the user will clear both 
window 7 1 and window 72 in Fig. 3 of all proposed relevant commands and 
input text. Pressing button 74 or saying the command, "Never mind", 
causes the whole application to go away. F; 5 . 4 shows the screen panel 
45 ?C of -" i<5 - 3 af:er -™ spoken entry, "Display the settings". The system 



COjld find nc actual -cnvr.anc in this terminology but was able to fi-< 



the 



four relevant commands shown in window 72. Cursor icon 76 is adjacent 
the spoken term in window 71 as an indication that this field is the 
speech focus. In Fig. 5 we have the display of Fig. 4, after the speech 
focus as indicated by cursor icon 76 has been moved to window 73 and the 
user has chosen one of the relevant commands: "Document Properties" 75 
by speaking the command; as a result, the command is highlighted. Upon 
the relevant command being spoken, the system will carry it out. 

Now with reference to Figs. 6 and 7 we will describe a process 
implemented by the present invention in conjunction with the flowcharts 
of these figures. Fig. 6 is a flowchart showing the development of a 
process according to the present invention for providing visual feedback 
to spoken commands and other terminology, including a listing of system 
proposed relevant spoken commands which the user may choose from. First, 
step 80, a set of recognizable spoken system and application commands 
which will drive the system being used is set up and stored. Then, there 
are set up appropriate processes to carry out the action called for by 
each recognized speech command, step 81. A process for displaying 
recognized speech commands is also set up. In doing so, the program 
developer has the option among others of displaying all recognized 
commands or only recognized commands which are not clearly recognized so 
that the user will have the opportunity of confirming the command. Then, 
step 83, there is set up a relevance table or table of relevant commands 
as previously described. This table hopefully includes substantially all 
descriptive phrases and terminology associated with the computer system 
and the actual commands to which each term is relevant. A process for 
looking up all spoken inputs, other than recognized commands, on this 
relevance table to then determine relevant commands is set up, step 84. 
This involves combining the system and application commands with the 
relevance table to generate the vocabulary of speech terms which will be 
used by the speech recognition system to provide the list of relevant 
commands. This has been previously described with respect to Fig. 2. 
Finally, there is set up a process for displaying relevant commands so 
that the user may choose a relevant command by speaking to set off the 
command action, step 85. This has been previously described with respect 
to Fig. 5. This completes the set up. 

The running of the process will now be described with respect to 
Fig. 7. First, step 90, a determination is made as to whether there has 
been a speech input. If No, then the input is returned to step 90 where 
a spoken input is awaited. if the decision from step 90 is Yes, then a 
further determination is mace in decision step 91 as to whether an 
command has been definitely recognized.. At this point, we should again 
distinguish, as we have above, between spoken commands which the user 
apparently does not intend to be carried out as commands, i.e., they are 
just part of the input terminology or spoken query seeking relevant 
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commands, and commands which in view of their presentation context are 
intended as definite commands. if a term in the context of a spoken 
query happens to match one of the commands, it is just listed with the 
relevant commands displayed as subsequently described with respect to 
5 step 97. on the other hand, if a definite command is recognized, then 

the decision at step 91 would be Yes, and the command is carried out in 
the conventional manner, step 92, and then a determination is made as to 
whether the session is at an end, step 93. if Yes, the session is 
exited. If No, the flow is returned to step 90 where a further spoken 
10 input is awaited. If the decision from step 9 1 was No, that a definite 

command was not recognized, then a comparison is made on the relevance 
table as previously described, step 95, and all relevant commands are 
displayed, step 97, to give the user the opportunity to select one of the 
relevant commands. At decision step 98, a determination is made as to 
15 whether the user has spoken one of the relevant commands. if y e s, then 

the process is returned to step 92 via branch "A" and the command is 
carried out. If the decision from step 98 is No, then a further decision 
is made, step 99, as to whether the user has spoken any further terms, 
if Yes, the process is returned to step 9 5 where a comparison is made to 
the relevance table and the above process is repeated. if the decision 
from step 99 is No, then the process is returned to step 93 via branch 
M B n where a decision is made as to whether the session is over as 
previously described. 

25 In this specification, the terms, relevant commands and actual 

commands may have been used in various descriptions. Both refer to real 
commands, i.e. commands which the particular system may execute. The 
distinction is based on whether the command is actually spoken. Thus an 
actual command would be one which the user actually speaks whether it be 

30 as part of the spoken entry or query which the user has uttered for the 

purpose of locating relevant commands cr the actual command is one which 
the user intends to be executed in the conventional manner. On the other 
hand, a relevant command would be a command which was not spoken by the 
user but was associated with a word or term in the user's spoken entry 

35 through the relevance table. 

One of the preferred implementations of the present invention is as 
an application program 40 made up of programming steps or instructions 
resident in RAM 14, Fig. during computer operations. Until required 
by the computer system, the procrar. instructions may be stored m another 
readable medium, e.g. in disk drive 20, or in a removable memory such as 
an optical disk for use in a CD ROM computer input, or in a floppy di.sk 
for use m a floppy disk drive computer input. Further, the program 
instructions may be stored in the r.erory c: another computer prior to use 
in the system of the present invent icr. and transmitted over a LAN or a 
wan, such as the Internet, when require-: by the user of the present 
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invention. One skilled in the art should appreciate that the processes 
controlling the present invention are capable of being distributed in the 
form of computer readable media of a variety of forms. 



15 



20 



40 



45 



12 



CLAIMS 



1- An interactive computer controlled display system with speech 
command input recognition comprising: 

means for predetermining a plurality of speech commands for 
respectively initiating each of a corresponding plurality of system 
actions , 

means for providing for each of said plurality of commands, an 
associated set of speech terms, each term having relevance to its 
associated command, 



means for detecting speech command and speech te 



rms , 



means responsive to a detected speech command for displaying said 
command, and 

means responsive to a detected speech term having relevance to one 
of said commands for displaying the relevant command. 

2. The system of claim 1 further including interactive means for 
selecting a displayed command to thereby initiate a system action. 

25 3 * The system of claim 2 wherein said means for selecting said 

displayed command includes speech command input means. 

4. The system of any of claims 1 to 3 wherein said speech commands and 
relevant commands are displayed s imultaneous iv . 

30 

5. The system of any one of the preceding claims wherein said means 
for providing said associated set of speech terms include: 

a stored relevance table of universal speech input commands and 
35 universal computer operation terms conventionally associated with actions 

initiated by said input commands, and 

means for relating the particular interactive interface terms cf 
said system with terms in said relevance table. 



6. A method for providing speech command input to an interactive 
computer controlled display system with speech command input recognition 



comprising : 



predetermining a plurality cf speech commands for respectively 
.iatir.g each of a corresponding plurality cf system actions, 



providing for each of said plurality of commands, an associated set 
of speech terms, each term having relevance to its associated command, 



detecting speech command and speech terms, 

displaying a speech command responsive to its detection as a speech 
command, and 

responsive to a detected speech term having relevance to one of 
said commands displaying the relevant command. 

7. The method of claim 6 further including the step of selecting a 
displayed command to thereby initiate a system action in response to a 
user interaction. 

8. The method of claim 7 wherein said step of selecting of said 
displayed command is performed in response to signals from a speech 
command input means. 

9. The method of any one of claims 6 to 8 wherein said speech commands 
and relevant commands are displayed simultaneously. 

10. The method of any one of claims 6 to 9 wherein said step of 
providing said associated set of speech terms includes: 

storing a relevance table of universal speech input commands and 
universal computer operations terms conventionally associated with 
actions initiated by said input commands, and 

relating the particular interactive interface terms of said system 
with terms in said relevance table. 

11. A computer program for speech command input recognition in an 
interactive computer controlled display system, comprising: 

program code for predetermining a plurality of speech commands for 
respectively initiating each of a corresponding plurality of system 
act ions , 

program code for providing for each of said plurality of commands, 
an associated set of speech terms, each term having relevance to its 
associated command, 

program code for detecting speech command and speech terms, 



program code responsive to a detected speech command for displaying 
said command, and 



program code responsive to a detected speech term having relevance 
to one of said commands for displaying the relevant command. 

12. The computer program of claim 11 further including program code, 
responsive to user interaction, for selecting a displayed command to 
thereby initiate a system action. 

13. The computer program of any one of claims 11 to 12 wherein said 
speech commands and relevant commands are displayed simultaneously. 

14. The computer program of any one of claims 11 to 13 wherein said 
program code for providing said associated set of speech terms includes: 

a stored relevance table of universal speech input commands and 
universal computer operation terms conventionally associated with actions 
initiated by said input commands, and 

means for relating the particular interactive interface terms of 
said system with terms in said relevance table. 

15. A computer program according to any one of claims 11 to 14, 
substantially as described herein with reference to any one of figures 1 
to 7 . 

16. A system according to claim 1, wherein said means for displaying 
commands displays a command for a predetermined time, the system further 
including : 

means for deselecting a system action designated by a displayed 
comma n d ; and 

means for executing a system action designated by a displayed 
command in the event that the system action is not deselected during said 
predetermined time period. 



